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ABSTRACT 



Loop gain normalization is employed in adaptive filters 
to control weighting of the filter characteristic updates 
in order to converge properly to a desired filter charac- 
teristic. Filter instability is avoided during intervals that 
transient or other rapidly pulsating signals are received 
or inputted by normalizing the update gain with a repre- 
sentation of a so-called fast attack estimate of a pre- 
scribed characteristic of the input signal; In one embodi- 
ment the fast attack estimate is the maximum of a plural- 
ity of power estimates generated from a corresponding 
plurality of subsets of amplitude samples of the received 
signal. In another embodiment, the maximum of the 
magnitude representations of the input signal samples is 
modified to represent the fast attack power estimate of 
the received signal. 

16 Claims, 3 Drawing Figures 
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input signal amplitude samples is modified to represent 

ADAPTIVE FILTER UPDATE NORMALIZATION the fast attack power estimate of the input signal. 

RELATED APPLICATIONS BRIEF DESCRIPTION OF THE DRAWINGS 
Copending application, Ser. No. 393,124, was filed 5 r The invention will be more fully understood from the 
concurrently herewith. following detailed description of an illustrative embodi- 
ment taken in connection with the appended figures in 
TECHNICAL FIELD which: 
This invention relates to adaptive filters and, more J FIG ' 1 shows in simplified block diagram form an 
particularly, to updating of the filter characteristic dur- 10 ada P tlve fllter including an embodiment of the Even- 
ing reception of prescribed signals. tIO £l^ ~ . 

FIG. 2 depicts in simplified form details of one em- 

BACKGROUND OF THE INVENTION bodiment of the power estimator employed in FIG. 1; 

Adaptive filters operate on a signal supplied thereto tc an l x/ -, , « . . .._ ... . ~ „ , 

in accordance with a prescribed criterion to generate a 15 / IG ;/> show * m . simplified block diagram form details 
desired output signal. Typically, the filters generate a - f ™*** embodiment of the power estimator of FIG. 
transfer function (an impulse response characteristic) in 

accordance with an algorithm which includes updating DETAILED DESCRIPTION 

of the transfer function characteristic in response to an , n KA ru . . ... A . ' 

error signal. In this way the filter characteristic is opti- 20 . Ad f. pt,ve F ' lter 100 ,nclu * n S ?? embodiment of the 

mized to yield the desired result. vir Tll 4 n ^'Tnn • "ock ^agram form in 

It has been found advantageous to normalize the F , IG t . 1- Adapt,ve filter 100 is broadly sim.lar to the 

update gain of the adaptive fitter. The normalization l ^ fil *° 

serves to make the performance of the filter insensitive *L Eft S&JV 0 ?* , 

to variations in received signal power. In one prior 25 J ™ ad f ^steble ^gnal processor having 

x . : fTL r - . ^ ■ , a closed loop error control system which is self-adapt- 

arrangement an average of the squares of input signal • {n ^ k P automatically tracks si ^ variation ^ 

sample^magnitudes is used to nonnah«r the gain as 0 * goi h Mofe spe y ciflcaU ^ ter m , 

described in an ^arhcle by Mr D. L. Duttweiler entided J ^ e ^ or fa * 

A Twelve-Channel Digital Echo C^celer", IEEE 3Q adapts transversal filter arrangement for synthesking 

Transactums on Commumcattons Vol. COM-26 No. 5, a Iincar approximation of system / 02 . 

May 1978, pp. 647-653. Another gain normalization To this end> far cnd incoming signal X(K) is usua]I 

arrangement employing a sum of the squares power hed from a far end ^ x source oyer a f tfans , 

esumate is disclosed m U.S. Pat. No. 3,922,505 issued mission path) ^ Iead 103 tQ a flfSt input of mter 1QQ 

Nov. 25, 1975. 35 and therein to an input of power estimator 104 and to an 

Although these prior arrangements perform satisfac- input of arbitrary system output estimator 101. Far end 

tonly in some applications, poor performance or possi- signal X(K) may bej for examplet a dig i ta i] y sarnp]ed 

bly mstabihty results when the received signal includes speech signalt where K is an integer identi f ying the 

transient signals, rapidly pulsating signals or the like. In sampling interval. A typical sampling rate is 8 kHz used 

telephone applications, instability may result in echo 40 in PCM transmission. Far end signal X(K) is also sup- 

canceler filters, for busy telephone signaling, multifre- plied via lead 10S( per h a ps through some conversion 

quency tones, other pulsating signals, data sets coming circuitry, e.g., a digital-to-analog converter not shown, 

and going, or the like. The instability results because the to arbitrary system 102, In an echo canceler application, 

average power estimate used m prior arrangements is arbitrary system 102 includes hybrid 106, matching 

relatively small for the transient signals thereby gener- 45 impedance 108 and bidirectional transmission path 107. 

ating an update gain which is too large. Even if the filter i t j s usually desirable for the input signal to hybrid 106 

does not become unstable, at best very poor conver- f rom i ea d 105 to be supplied over bidirectional path 107 

gence results, i.e., the characteristic converged to does to a near-end listening party. However, because of an 

not closely represent the desired characteristic. These impedance mismatch in hybrid 106, typically caused by 

results are undesirable. 50 balance impedance 108 not exactly matching the impe- 

SUMMARY OF THE INVENTION dance of bidirectional path 107 a portion of the hybrid 

input signal appears on outgoing lead 109 and is re- 
The problems of prior adaptive filter normalization fleeted to the far end signal source as an echo signal, 
arrangements resulting from updating the filter charac- Similarly, any arbitrary system 102 will generate a sys- 
teristic when transient signals, rapidly pulsating signals 55 tern output signal which differs from that generated by 
or the like are being received or inputted are overcome, estimator 101 until adaptive filter 100 converges to the 
in accordance with an aspect of the invention, by nor- arbitrary system characteristic. The output of arbitrary 
malizing gain in the filter update process with a repre- system 102 is, therefore, equivalent to the echo signal in 
sentation of a so-called fast attack estimate of a pre- an echo canceler application. The output signal of arbi- 
scribed input signal characteristic. Specifically, the fast 60 trary system 102 is supplied over lead 109 to another 
attack estimate representative of input signal power is input of filter 100 and therein to a first input of combin- 
used to normalize the update gain. In one embodiment, ing network 110. Lead 109 may also include conversion 
the fast attack estimate is the maximum of a plurality of apparatus, e.g., an analog-to-digital converter not 
power estimates generated from a corresponding plural- shown. A second input to combining network 110 is a 
ity of subsets of amplitude samples of the input signal. 65 signal estimate of the arbitrary system output signal 
Each of the subsets includes a predetermined number of generated by estimator 101. The arbitrary system out- 
amplitude samples. In another embodiment, the maxi- put estimate is supplied via lead 111 from an output of 
mum of representations of magnitudes of the plurality of estimator 101 to the second input of combining network 
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110. Combining network 110 generates error signal 
E(K) corresponding to the algebraic difference between 
the arbitrary system output estimate from estimator 101 
and the output from arbitrary system 102. Error signal 
E(K) is supplied over a second transmission path, e.g., 
lead 112 to the far end source and to estimator 101. 

Estimator 101 includes a so-called tapped delay line 
comprised of delay units 115-1 through 115-(N— 1) (a 
shift register) for realizing desired delays at the taps 
corresponding to convenient Nyquist intervals. There- 
fore, delayed replicas X(K- 1) through X(K - N+ 1) of 
mcoming far end signal X(K) are generated at the corre- 
sponding taps. The signal at each tap position, namely 
X(K-1) through X(K-N+1) as well as X(K), is ad- 
justed in response to error signal E(K). More particu- 
larly, signals X(K) through X(K-N+1) are individu- 
ally weighted in response to E(K) via a corresponding 
one of adjustment networks 116-0 through 116-(N— 1), 
respectively. Adjustment networks 116-0 through 116- 
(N— 1) each include muitipliers 117 and 118, and feed- 
back loop 119. Feedback loop 119 adjusts the tap 
weight to a desired value in a manner which will be 
apparent to those skilled in the art and explained in the 
above-noted references. In this adjustment, it is impor- 
tant to appropriately adjust the individual loop gains 
(G) to result -in a stable system. This is realized by nor- 
malizing loop gain G by dividing it with an estimate of 
a prescribed characteristic of input signal X(K). In this 
example, an estimate of input signal power P(X) is em- 
ployed as a normalization control signal and generated 
by power estimator 104. Normalization control signal 
P(X) is supplied to controllable gain unit 121 in each of 
adjustment networks 116. See for example, the article 
entitled "A Twelve-Channel Digital Echo Canceler" 
noted above which discloses use of an average, i.e;, a 
long term estimate P(X) of the power of X(K) to nor- 
malize loop gain G, namely, G/P(X). The weighted 
replicas, i.e., amplitude coefficient signals of X(K) from 
adjustment networks 116-0 through 116-(N— 1) are 
summed via summing network 120 to generate the arbi- 
trary system output or echo estimate signal approximat- 
ing the output from arbitrary system 102 or the echo to 
be canceled. The arbitrary . system estimate is supplied 
via lead 111 to the second input of combining network 
110. • • \ -V 

FIG. 2 shows in simplified block diagram form one 
embodiment of power estimator 104 which may be 
utilized, in accordance with an aspect of the invention, 
to generate a representation of a fast attack estimate of 



plurality of short term estimates of the prescribed char- 
acteristic of X(K). In this example, each of function 
generators 202 generates a short term estimate of power 
of X(K) from a subset of samples, namely 



(0 



where ai=X(l-i+l), 

1 is the time index of the first sample of the M sample 
block or subset supplied to the individual ones of func- 
tion generators 202, and M^N. Since M^N there are 
N— M+l blocks or subsets of M consecutive samples 
which can be used in generating power estimates. When 
transient or rapidly pulsating signals are received the 
mean square power estimate over all of the amplitude 
samples stored in delay elements 201, i.e., the average 
power estimate, is too small a value for normalizing the 
filter loop update gain without the possibility of the 
filter becoming unstable. What is desired is to generate 
the mean square power estimate only over the samples 
including the transient or pulsating signal amplitude 
values, i.e., a fast attack power estimate. This is 
achieved, in accordance with an aspect of the invention, 
by selecting the number of samples M in a block or 
subset to be a predetermined number which represents a 
so-called window of the samples in delay elements 201. 
In this example, the windows overlap to insure that if a 
representation of the transient or pulsating signal is 
stored in elements 201, it will be captured. Stated an- 
other way, a window of M samples is essentially shifted 
along delay elements 201, in this example, one element 
at a time to generate simul taneously a plurality of power 
estimates corresponding to the plurality of windows of 
M samples. Since the mean square average of the sam- 
ples in a window or subset including the transient or 
pulsating signal is significantly larger than the power in 
the other windows, the desired fast attack power esti- 
mate P(X) is readily obtained by selecting the maximum 
level. Thus, function generator 202-1 is supplied with 
the current sample X(K) through sample X(K— M+l) 
to generate power estimate f(l) in accordance with 
equation 1. Similarly, function generator 202-2, is sup- 
45 plied with the first delayed sample X(K— 1) through 
sample X(K— M) to generate power estimate f(2) in 
accordance with equation 1. This procedure is iterated 
until finally function generator 202-(N— M-t-1) is sup- 
plied with sample X(K— N+M) through sample 
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a prescribed characteristic of received signal X(K). In 50 X(K-N+1) to generate power estimate f(N-M+l), 



this example, not to be construed as limiting the scope 
of the invention, the prescribed characteristic of signal 
X(K) is a power estimate P(X). As indicated above, 
estimator 104 is employed, in accordance with an aspect 



also in accordance with equation 1. Therefore, function 
generators 202-1 through 202-(N-M+l) simulta- 
neously generate a plurality of short term estimates of 
input signal power each of which is the average of the 
of the invention, to generate a fast attack estimate of 55 sum of the squares of the magnitudes of M samples of 
power P(X) of X(K). Power estimate P(X) is supplied to the received signal as indicated in equation 1. In one 
each of adjustment networks 116 (FIG. 1) for normaliz- example, N= 128 and M= 16. Apparatus for generating 
ing update gain G in well known fashion, namely, the average of the sum of the squares of a plurality of 
G/P(X). ; samples is known in the art. See for example, the article 

Accordingly, shown in FIG. 2 are a plurality of delay 60 entitled, "A Twelve-Channel Digital Echo Canceler", 



elements 201-1 through 201-(N— 1) for example, a shift 
register for generating N delayed versions of received 
signal sample X(K), namely, X(K — 1) through 
X(Kt-N+1). The delay interval is equal to the sam- 
pling interval. Predetermined ones, i.e., subsets of re- 
ceived signal samples X(K) through XL(K— N+ 1), are 
supplied to individual ones of function generators 202-1 
through 202-(N— M + l) to generate a corresponding 



65 



noted above. 

Outputs. f(l) through fi(N— M-f- 1) from function gen- 
erators 202 are supplied to selector 203. Selector 203 is 
employed to select from f(l) through f(N— M+l) in 
accordance with a prescribed criterion signal P(X) 
which is representative of a fast attack estimate of the 
prescribed characteristic of input signal X(K).. In this 
example, selector 203 is employed to select as P(X) the 
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maximum of signals f(l) through f(N— M+l) each of and noise. The ideal situation is to adjust the crest factor 

which represents a short term estimate of power of for each such type of received signal. This is not practi- 

input signal X(K). Selecting the maximum from the cat at this time. Thus, an output from summer 305 is 

plurality of short term power estimates is straightfor- approximately representative of log2 P(X), where P(X) 

ward. For example, the maximum is readily obtained by 5 is the desired short term power estimate. The log2 P(X) 

comparing each value of f(l) through f(N-M+ 1) in signal is supplied to be subtracted from the logarithm of 

turn with the largest of the previous values starting with ga i n q m gam um t 121 in each adjustment, networks 

an initial value of zero. Thus, for i = l to N— M + l, if 116-0 through 116-(N— 1) (FIG. 1) to realize the nor- 

f(i)>f (max), set f (max)=f(i). Fast attack power esti- malization of the update gain, namely, G/P(X). 

mate P(X) is supplied to normalize the update gain, io What is claimed is: 

namely, G/P(X), in gain unit 121 in each of adjustment t In an adaptive transversal filter of the type includ- 

networks 116-0 through 116-(N— 1) (FIG. 1). ing ; 

FIG. 3 shows in simplified form another embodiment a pluraljty of means each for generating a corre- 

of power estimator 104 for generating a normalization spon ding one of a plurality of amplitude coefficient 

control signal which, m this example, is representative 15 si ^ said p i urality of amplitude coefficient sig- 

of a fast attack power estimate P(X) of received signal ^ fonni ^ ^ mse fe ^ of said 

^IJ*? 1 ^' refe 7v^°. eqt ,? ' 1 r amplitude coefficient signal generating means in- 

N - 128. Received s lg na X(K), typically mcludes sam- * controllable ga* mLis responsive to a 

pies of a signal in digital form each representative of a nonna Lation control^al for normalizing gain 

,t-law quantized amplitude sample. Each suoh djptal 20 used . ^ ^ f orresponding „ 

sample representation mcludes a sign bit, three segment «- * + ■ 1 

bits and four step bits. coefficient signal; 

As described above, a mean square power estimate of me # f s responsive to a received signal for genera ing 

the transient of pulsating signal is desired. It is known normalization control signal, said normalization 

that peak power is approximately related to the mean 15 ^ generating means including, 

square estimate by a so-called crest factor y, namely, means for a Plurality of representations of 

t jJ at a prescribed characteristic of the received signal 

and 

pmMAx m means for selecting one of said plurality of represen- 

PW = ^ 2 3() tations in accordance with a prescribed criterion as 

y said normalization control signal. 

It is also known that subtraction is simpler than multipli- 2 - The invention as defined in claim 1 wherein said 

cation. Therefore, if representations of the logarithms of representations of a prescribed characteristic are repre- 

P(X)MAX and y* are available, the desired mean square of. power estimates and wherein said^ pre- 

fast attack power estimate is obtainable by subtracting 35 scribed cr ! tenon 15 to u ^ maximum value of said 

the logarithms. It is also known that for u-law digital power estimates as the normalization control signal, 

representations of amplitude samples, the segment bits 3 - ^ Invent,0 f n as defmed m chum 2 * herem sa ' d 

are an approximate representation of the log base 2 of representations of power estimates are each represen a- 

the corresponding sample magnitude, see for example, *ve of peak power of portions of the received signal. 

U.S. Pat. No. 4,189,715 issued to D. L. Duttweiler on 40 4 - The invention as defined in claim 2 wherein said 

Feb 19 1980 representations of power estimates are each representa- 

Acco'rdingly, as shown in FIG. 3, received signal tive of mean square power of portions of the received 

sample X(K) is supplied to segment extractor 301 for "^11 . * * ^ • 1 ■ « 1. ■ j 

obtaining the segment bits of the received samples. This 5 * Tte invention as defined m claim 1 wherein said 

is readily realized by employing a corresponding plural- 45 received signal includes a sequence of amplitude sam- 

ity of gates which are enabled to pass only the three P^> said means for generating a plurality of representa- 

segment bits to delay element 302-1 and, in turn, to tions includes means for generating said plurality of 

delay elements 302-2 through 302-(N-l). Delay ele- representations from subsets of said amplitude samples, 

ments 302 may be a shift register for storing N delayed each subset comprising a predetermined number of said 

replicas of the segment bits XS(K), namely, XS(K-1) 50 amplitude samples. 

through XS(K-N + 1). As described above, segment * The invention as defined in claim 5 wherein said 

bits XS(K) through XS(K-N+1) are approximately predetermined number of amplitude samples is at least 

representative of the logarithms of the magnitudes of one, said prescribed characteristic is power, and said 

the corresponding samples. The maximum of signals prescribed criterion is to select the maximum of the 

XS(K) through XS(K-N+1) is obtained via maximum 55 plurality of power representations, 

selector 303 in well-known fashion and, in turn, sup- 7. The invention as defined in claim 5 wherein said 

plied via amplifier 304 to a summing input of summer predetermined number is a plurality of amplitude sam- 

305. Amplifier 304 has a gain in this example of two (2). pies, said prescribed characteristics is mean square 

Consequently, the output of amplifier 304 is approxi- power of the plurality of amplitude samples in each 

mately 2 log2 X(K)MAX or representative of 60 subset, and said prescribed criterion is to select the 

P(X)MAX. Signal £ is supplied to a subtracting input of maximum mean square power. 

summer 305. Signal 0 is selected to be 2 iog2 7 where y 8. The invention as defined in claim 1 wherein said 

is the crest factor or peak factor, in this example, for a received signal includes a sequence of amplitude sam- 

speech signal. Such a crest factor value is readily ob- pies, wherein said means for generating a plurality of 

tained by a computer simulation in well known fashion. 65 representations includes means for storing a plurality of 

It should be noted that selection of the crest factor for magnitude representations of said received signal sam- 

speech is somewhat of a compromise because the crest pies, wherein said means for selecting comprises means 

factor is different for other type signals, e.g., sine waves for selecting at least one of said stored magnitude repre- 
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sentations in accordance with a first criterion, and means responsive to a received signal for generating 

wherein said normalization control signal generating said normalization control signal, said normaliza- 

means further includes means for modifying said at least tion °° ntro1 generating means including 

one selected magnitude representation in accordance for *™™ Xin * a f * st att ** power estimate of 

with a second criterion to generate said normalization J^fo^ 

cont ™ sl ^ naI ' . . . , . . , . . . said normalization control signal to said controlla- 

9. The invention as defined in claim 8 wherein said We ^ mcans in each of ^ amplitude coefficient 
first criterion includes selecting the maximum value of signa j generating means. 

said stored magnitude representations and said second l0 The invention as defined in claim 11 wherein said 

criterion includes scaling said selected maximum value fast attack power estimate generating means comprises 

by a predetermined scaling factor. means for generating a short term power estimate of the 

10. The invention as defined in claim 9 wherein said received signal. 

scaling factor is a crest factor selected for a speech 13. The invention as defined in claim 12 wherein said 

signal and said stored magnitude representations are 15 short term power estimate generating means includes 
representative of the logarithms of the magnitudes of means for generating a plurality of power estimates of 

the corresponding amplitude samples. the received signal and means for selecting the maxi- 

11. In an adaptive transversal filter of the type includ- mum value of sald P ower estimates as said short term 

power estimate. 

mg: , i*. c , , n ^™ 20 14. The invention as defined in claim 13 wherein said 

a plurality of means each for generating a corre- ^ ffi t ^ of portions 

sponding one of a plurality of amplitude coefficient of the received signal. 

signals, said plurality of amplitude coefficient sig- 15 ^ invention m defined in claim 13 wherein said 
nals forming an impulse response, each of said p0 wer estimates each represent mean square power of 
amplitude coefficient signal generating means in- 2 5 portions of the received signal, 
eluding controllable gain means responsive to a i<>. The invention as defined in claim 13 further in- 
normalization control signal for normalizing gain eluding means for scaling said selected maximum value 
used in updating said corresponding amplitude by a predetermined scaling factor, 
coefficient signal; ***** 

30 



35 



40 



45 



50 



60 



06/17/2004, EAST Version: 1.4.1 



